Description

Feeds are now processed as batched jobs.

Notes:

• Pagination is still supported, as it was before. If you have a feed that has 3 pages, each page has, e.g. 200 primary elements to be processed, then each page will take two batches.
• services/Process.php->processFeed() - the last parameter ($feedData) is no longer optional
• services/Process.php->afterProcessFeed() - now accepts the 4th param ($startTime); it’s needed for the time calculations to work correctly for the paginated view; if omitted, the time calculation will still work, but as before - timing only the last page
• services/Process.php->beforeProcessFeed() is now split into 2 methods, beforeProcessFeed(), which runs before each page (if the feed is not paginated, then there’s only one page), and getFeedSettings(), which runs before each batch
• Processing X elements finished in <number>s => it looks like this was a bit buggy before for paginated feeds; it reported the total number of processed items but only really measured the time of the past page (fixed now)
• it looks like the logs were always a bit wonky for the paginated feeds; they were always nesting one of the processed elements under Finished preparing for feed processing. because the $stepKey was not cleared as expected (fixed now)

Related issues

#1584